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Abstract : Some remarkable properties of the beta distribution are based on relations in- 
volving independence between beta random variables such that a parameter of one among 
them is the sum of the parameters of an other (see (1.1) et (1.2) below). Asci, Letac and 
Piccioni [1] have used the real beta-hypergeometric distribution on H to give a general 
version of these properties without the condition on the parameters. In the present paper, 
j> , we extend the properties of the real beta to the beta distribution on symmetric matrices, 

we use on the positive definite matrices the division algorithm defined by the Cholesky 
■ decomposition to define a matrix-variate beta-hypergeometric distribution, and we extend 

to this distribution the proprieties established in the real case by Asci, Letac and Piccioni. 
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1 Introduction 

Consider the gamma distribution on H, with scale parameter a > and shape parameter 
P>0, 

7 P ,a{dy) = Y^ e ' ay y p ' ll (o,+oo)(y)dy. 

Let U and V be two independent random variables with respective gamma distributions 
J P ,a, 7q,a, and define 

U U 

Then the distribution of X and Y are called the beta distributions of the first and of the 
second kind with parameters (p, q) and are denoted by (3p]q and flj^q respectively. 



"Corresponding author. E-mail address: abdelhamid.hassairi@fss.rnu.tn 



1 



The beta distributions of the first and of second kind on M have many remarkable prop- 
erties. For instance, it is well known (see [1]) that 



if W~fil>*! ^ independent of X ~ p™, then (1.1) 
And it is shown in [3] that 



if W ~ /?2 a> , X ~ /?« , W ~ /?2 a> , are independent, then - ■ \ ~ X. (1.2) 

In these two properties, the random variables W and W' are beta distributed with first 
parameter equal to the sum of the parameters of the distribution of the variable X. Asci, 
Letac and Piccioni [1] have used the so-called real beta-hypergeometric distribution to 
extend these results to the general case where W ~ pj®, W ~ p®, with b > not 
necessarily equal to a + a'. Recall that the hyper geometric function p F q is defined for 
positive numbers a±, a p ; b\, b q , by 

tp t u u \ -ST" (ai)n---(a p ) n n / n r(a + n) 

pFg(ai,...,ap;6i,...,6g;x) = ^ -jt^ 7^2; ,with (a) n = . 

^ n!(&i) n ...(& 9 )„ 1(a) 

The beta-hypergeometric distribution with parameters (a, a', 6) is then defined by 

Ha,a>,b{dx) = C(a,a',6)a; a_1 (l - x) 6_1 2 ^i(a, 6; a + a; x)l (0il) (x)dx, 

where 

6 (a, a , o) - 
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T(a)T(b) 3 F 2 (a, a,b;a + b,a + a'; 1) ' 

Note that the distribution /J- a ,a',b, reduces to a P^ a , when b = a + a'. 
Asci, Letac and Piccioni have shown that 

if X ~ ^ a ,a',& and ~ /^j, are independent, then - - ~ /V,a,& (1-3) 

and 

if ~ p^l, W' ~ and X > are independent, then (1.4) 

X ~ 1 l 1 ^ if ° nly if X ~ Ma,o',6- 

In the present work, we first extend the properties in (1.1) and (1.2) to the beta distri- 
butions on symmetric matrices. We then use results from harmonic analysis on symmetric 
cones, and a division algorithm defined by the Cholesky decomposition to extend the def- 
inition of a beta-hypergeometric distribution to the cone of positive definite symmetric 
matrices generalizing the definition of a beta distribution on matrices (see [5]). These 
distributions are then used to extend to symmetric matrices the results established in 
the real case by Asci, Letac and Piccioni. It is worth mentioning here that in a private 
communication, Letac has given a definition of a beta-hypergeometric distribution on sym- 
metric matrices using a division algorithm based on the notion of quadratic representation. 
The use of the division algorithm defined by the Cholesky decomposition is crucial in our 
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work, it allows the calculation of the spherical Fourier transform which the key tool in 
some proofs. The paper has the following plan. In Section 2, after a review of some facts 
concerning the beta distributions on symmetric matrices, we establish the matrix versions 
of the properties (1.1) and (1.2). We then introduce the matrix beta-hypergeometric distri- 
bution and we show some preliminary properties concerning this distribution. In Section 3, 
we state and prove our main results, in particular we use the matrix beta-hypergeometric 
distribution to give a matrix version of (1.3) and (1.4). 



2 Matrix variate beta-hypergeometric distribution 

Let V be the linear space of symmetric rxr matrices on IR, and fi be the cone of positive 
definite elements of V. We denote the identity matrix by e, the determinant of an element 
x of V by A(x) and its trace by trx. We equip V with the inner product (x,y) = tr(xy), 
for all x, y £ V. For an invertible rxr matrix a, we consider the automorphism g(a) of 
V defined by g(a)x = axa* where a* is the transpose of a. We denote G the group of such 
isomorphisms, K the subgroup of elements of G corresponding to a orthogonal, called the 
orthogonal group. As mentioned above, we will use the division algorithm on matrices 
based on the Cholesky decomposition of an element y of that is on the fact that y can 
be written in a unique manner as y = tt* , where t is a lower triangular matrix with strictly 
positive diagonal (see [2]). For an element x in V, we set ir(y)(x) = txt*, and we define 
the "quotient" of x by y as TT~ 1 (y)(x) = t~ 1 x(t*)~ 1 , which, for simplicity, we sometimes 
denote abusively |. 

Consider the absolutely continuous Wishart distribution concentrated on f2 with shape 
parameter p > (r — l)/2 and scale parameter cr £ fl, 

W p , a (dx) = {A r {a ^~ P eM-tr(xa- 1 ))(A(x)r- r -^l n (x)dx, 

where 

T n (p) = (27r) rjL T 11 f[T(p-(k-l)/2). 

k=i 

If U and V are two independent Wishart random matrices with the same scale parameter 
a and respective shape parameters p > and q > then the random matrix ir~ 1 (U + 

V){U) has the so called beta distribution (of the first kind) /3^q on SI n (e — O) given by 

/3«(dx) = ( J B c (p,g))- 1 (A(x)f- r * i (A(e-x))^ 1 * i l nn(e _ f , ) (x) ( ix, 
where the normalizing constant B^(p,q) is the multivariate beta function defined by 

T n (p)T n (q) 

Bn(p ' ,) = T^5rnr 

We also have the beta distribution (of the second kind) f3p 2 q on ft given by 

$l(dx) = (i? n (p,g))- 1 (A(x)f- 1 * i (A(e + x))"^)l n (x)dx. 

It is the distribution of the random matrix 7r~ 1 (y)([7), or equivalently the distribution of 
7r _1 (e — Z)(Z) with Z ~ f3^. More precisely, we have: 
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(2) 

Proposition 2.1 Let Y be a random matrix in Q. Then Y ~ f3p^ if and only if Z = 
ir-He + Y)(Y)~til 

Proof Let Y ~ 4?<J and Z = 7r -1 (e + F)(y) which is equivalent to F = 7r -1 (e - Z)(Z). 
For a bounded measurable function h, we have 

E{h(Z)) = (Bn&g))- 1 [ h(n-\e + y)(y))A( y y- r -¥A(e + yr^dy 

= (Bn(p,g)) _1 / / i (z)A(vr- 1 (e-z)(z)) p - 1 ^ i A(7r- 1 (e-z)(e))-^ + ' ? )A(e-z)-( r + 1 )^ 
= (Bn(p,g)) -1 / ^(zr^Ate-z)"- 1 ?^. 

JQn(e-Si) 



Thus Z ~ 



In a same way, we verify that if Z ~ then 7r 1 (e — Z){Z) ~ /3p^. □ 

Now, we give the matrix versions of (1.1) and (1.2). 
Theorem 2.1 Let W', X and W be three independent random matrices valued in CI. 

i)If W'-P^j and X~pW, then (2.5) 

n-He + n(X)(W'))(e)~til. 

ii) IfW~ X ~ /?« and W ~ ^ a> , , then (2.6) 

7r _1 (e + 7r _1 (e + n{X)(W')){W)){e) ~ X 

Proof i) Let W' and X be two independent random matrix such that W ~ /3^ a / a / and 
X ~ /3^/. It is known (see Theorem 2.2 in [6]), that ir(X)(W') ~ Z?^/, and according to 
Proposition 2.1, we obtain that 7r _1 (e + 7r(X)(W))(*"P0(W)) ~ It follows that 

n~\e + n(X)(W'))(e) = e - [^(e + 7r(A)(^'))(^P0(^'))] - /# ?«■ 

ii) As 7:~ 1 (e + 7:(X)(W r )){W) = t^tt" 1 ^ + ir(X)(W')(e))(W), then according to The- 
orem 2.2 in [6] and to (2.5), we obtain that 7r _1 (e + ir(X)(W')) (W) ~ 0$ . 
Therefore 7r _1 (e + 7r _1 (e + 7r(X)(W , ))(W))(e) ~ X □ 

In what follows, we will be interested in the extension of the results in Theorem 2.1 to 
the case where the parameter a + a' in the distributions of W and W' is replaced by any 
parameter b not necessary equal to a + a! . For this we require some further terminology. 
Let V denote the space of polynomials on the space V of symmetric r x r matrices. A 
natural representation % of the group of automorphisms of V is defined for g in this group 
and p in V by (H(g)p)(x) = p(g~ 1 x). 

For X = (Xj)i<jj<r in CI and 1 < /c < r, let Aj,(X) denote the principal minor of order 
k of X, that is the determinant of the sub-matrix Pk(X) = ((Xj)i<ij<fe)- The generalized 
power of X is defined for s = (s\, s r ) G(D r , by 

A S (X) = (A 1 (X)y^(A 2 (X)y*- s \..(A r (X)r. 
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For a given m = (mi, . . . , m r ) € !N r which satisfies m\ > m<i > . . . > m r > (denoted by 
m > 0), we denote by V m the subspace of V generated by the polynomials rl(g)A m where 
g £ G. The spherical polynomial (fi m is defined in [4] by 



<p m (x) = / A m (kx)dk. 
Jk 



Up to a constant factor, the <p m are the only iT-invariant polynomials in V m . 
The definition of the beta-hypergeometric distribution on the cone of positive definite 
symmetric matrices relies on the notion of hypergeometric function which appears in [4], 
page 318. For instance, for a = (a±, . . . , a r ) in(C r and m = (mi, . . . , m r ) in !N r such that 
m > 0, we write 

_ T n (a + m) _ i - 1 ^ 

\U) m — , s — I I {lit jrrii, 

r^(a) 2 

and for aj = (aj, . . . , a[) in (D r , i = 1, . . . ,p and /3j = (/3j, . . . , in(D r , j = 1, . . . , g, we 
define the hypergeometric function 

p Fq (ai,..., a p ; /3i,..., /3 9 ;x) = ^ («i)m ■ ■ ■ (a p ) m ^__ dm ^ x ^ 

m>0 {P 1 ' 771 ' ' ' KPqJm { r )m 



where d m is the dimension of V m . Note that we can define the hypergeometric function 
for some complex Qj and f3j, i = 1, . . . ,p, j = 1, . . . , q, where(aj) m = IIj=i( a i — ^r) 



and (&) ro = IU=i(& " ¥W 
It is shown in [4], page 318, that the domain V of convergence of this series is: 

• V, if p < q, 

• D = {w; \w\ < 1} where |.| is the spectral norm, if p = q + 1, 

• 0, if p > q + 1. 

As it is done for the real beta-hypergeometric distribution (see[l]), we will be interested 
in the case p = q + 1. We will first show that under some conditions, the definition of 
q+ \F q (x) may be extended to x = e. This is in fact equivalent to show that the series (2.7) 
converges when x = e. 

Proposition 2.2 Let ctj = (a], . . . , a£) and f3j = (/3j, . . . , /3J) in M r , such that a* ^ ^ 
and (3) ^ for all i = 1, . . . , r. Denote for i = 1, . . . , r, 



* = E $ - E «. 

Then the series 



r 

i<j<q i<i<?+i 



• • • (<Vt-l)m 1 ^ ^ £ 



converges if and only if, for all 1 < k < r, 



j2 Cl >l + k(r-k)- Hr + L) 
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Note that in particular c\ > L ^-, and when r = 1, the condition reduces to c\ > 0. 
Proof Let ctj = (aj, . . . , op G IR r and /3j = (/3j, . . . , /3p in IR r . We will consider separately 
two cases: 

• Case where a* > % -^- and /3* > ^ for alH = 1, . . . , r. 

Denote pi = m,i — mj+i, for i = l,...,r, where m r+ i = 0. Then (pi, . . . p r ) G !N r 
and m, = J2l=iPk- 
Using the fact that 

rf ™ - II {l + mi-rrij), 

l<i<j<r 

(see [4], page 286), we obtain that 

l<i<j'<r fc=i 

On the other hand, by Stirling approximation, we have that for rrii ^ 0, 

1 ^ 7 2 ' I 

, j _ & - I s m i rxijl 
V*i 2 M ~ r(Q i _ i^i) • 

Then 

r \ j 2 ' i 
/ \ rr m i m i- ■ , , , 

("j)m - 11 * , _ , j = l,...,g + l. 

i=l 1 l a j 2 J 

Consequently, the term of the series (2.8) is equivalent to 

A^.^Arfictpkr^ n (i + 5>*)> 

i=l fc=i l<i<j <r* fc=j 

where ^ = ^'^I^Tl'^ and c, = £ 1<j<(? % -£i< j<9+ i aj, t = 1, . . . , r. 
Hence, the series (2.8) converges if and only if for all 1 < k < r, 

f>>l + A;(r-A0-^±^ • 
i=i 2 



• Case where a*- < or /3j < ^ for some i = 1, . . . ,r. There exists k G IN such 
that — k < a* — ^ < — fc + 1. This implies that (a* — ^) mi = — ^f^OfcO 2 } — 
^ + fe)mi-fc f° r m « > Then also the series (2.8) is convergent if and only if 
Ef=i Ci > 1 + k(r - k) - ^±12 for a11 1 < k < r. 



□ 



Note that if a* = L ^-, for some i = l,...,r, then in the case where mi = 0, (ay)? 
Hence the series (2.8) is convergent if and only if 

^ Cj > 1 + fc(r - k) - k ( r + V for all 1 < jfe < i - 1. 

3=1 2 
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We are now in position to introduce the beta-hypergeometric distribution on symmetric 
matrices. 



Definition 2.1 The beta-hypergeometric distribution, with parameters (a,a',b) G G 11 ^-, +oo[)' ; 
is defined on f2 fl (e — Q) by 



li a ,ai,b{dx) = C(a,a',b)A{x) a ~-£\{e-x) h -- 2 F 1 (a,b;a + a';x)l nn{e ^ n) (x)(dx), (2.9) 
where 

C(a, a ,b) = 



Fn(a)T n (b) 3 F 2 (a, a,b;a + b,a + a';e)' 



Note that the distribution fi a ,a',a+a' 1S nothing but the distribution P^,. In fact, since we 
have 

2 F 1 (a,b;a + a';x) = A(e - x) a '- b 2 F 1 {a' ,a + a' - b;a + a';x), (2.10) 
(see [4], page 330), then (2.9) becomes 

Va,a>,b{dx) = — — ■ — — — ■ — 2 Fi{a ,a+a -b;a+a ;x)p y J ,(dx). 

T n (a + a')T n (b) 3 F 2 (a,a,b;a + b,a + a';e) 

(2.11) 

When a + a' — b = 0, 3^2(0, a, 6; a + 6, a + a'; e) becomes 2-^1 (a, a; 2a + a'; e). This, using 
the following Gauss formula 

for a = /3 = a and 7 = 2a + a' shows that n a ,a',a+a' coincides with j3^\,. 
Next, we calculate the spherical Fourier transform of a beta-hypergeometric distribution, 
it is the expectation of its generalized power. This transform is important, it plays, for 
the K- invariant distributions on symmetric matrices, the role that the Mellin transform 
plays in the real case. 

Proposition 2.3 Let X be a random variable having the beta-hypergeometric distribution 
t^a,a',b defined by (2.9). Then for t = (ti, ... ,t r ) G M r such that U + a > for all 
1 < i < r, the spherical Fourier transform of X is 

E(A (X)) = r ^( Q + b ) r n (t + a) 3 F 2 (a,b,a + t;a + a' ,t + a + b; e) 
[ t{ r n (o) T n (t + a + b) 3 F 2 (a,a,b;a + b,a + a';e) ' 1 ' ' 

Proof 

E(A t (X)) = C(a,a',b) I A t (x)A(x) a -^ A(e - x) b " r 2 Fi(o, b; a + a'; x)dx. 

Since the determinant and the hyper geometric function are if- invariant, for k G K, 
E(A t (X)) = C(a,a',b) [ A t {x)A{k- l x) a -^ A(e - k^x)^^ 2 Fi(a, b; a + a'; k~ l x)dx. 
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With the change of variable y = k 1 x, we can write 

E(A t (X)) = C(a,a',b) [ A t (ky) A(y) a ~ T A(e - y) b ~T ^(a, b; a + a'; y)dy 

= C(a,a',b) [ A t (ky)A(ky) a -TA(e-ky) b -T 2 F 1 (a,b; a + a';y)dy 

Jnn(e-n) 



'nn(e-n) 

C(a,a',b) J2 7^4^? / / Mky)A(kyr-TA(e-ky) b -TA m (ky)dkdy 

r f^ Q (a + a') m {-) m Jnn(e-n) Jk 

C(a,a>,b) £ - ^7 (5) - d m / A m+t+a _ a ( y )A(e- y ) 6 -^ 



m>0 



y- (a)m(b) m T n (a + b) T n (m + t + a)Tn(b) 

^ (a + a') m (*) m m T n (a)T n (b) 3 F 2 {a,a,b;a + b,a + a';e) r n (m + t + a + 6) 



m>0 



E (a)mWmft+_a)m , ^(a + 6) Tn(t + a) 

r„ _i_ „n r+ _i_ „ _l m (r\ n 



Q (a + a') m {t + a + b) m (j) m T n (a) 3 F 2 (a, a,b;a + b,a + a'; e) T n (t + a + b) 

Tn{a + b) Tn(t + a) 3 F 2 (a, 6, a + t; a + a', t + a + 6; e) 
rn(a) r^(t + a + 6) 3 F 2 (a, a, 6; a + 6, a + a'; e) 

□ 



3 Characterizations of the beta-hypergeometric 
distributions 

In this section, we state and prove our main results involving the beta-hypergeometric 
probability measure fJ, a ,a',b- 

(2) 

Theorem 3.1 Let X and W be two independent random matrices such that W ~ /3^ a , 
and X ~ fJ- a ,a',b- Then 

TT-\e + 7r(X)(W))(e) ~ Ma>;b . (3.14) 
For the proof, we need to establish the following technical result. 
Proposition 3.1 For a, a', b e] 11 ^,^ and z £ !1 n (e - ft), we have 

f A(e-tr +a '~TA(t) b -T , T n (a')Tn(b) 

/ — XI ( \u\\a'+b — 2F 1 (a,b;a+a;e-t)dt = 2 F 1 (a ,b;a+a ; z). 

Jnn(e-Q) A(e - ■n{z){t)) a + b T n (a' + b) 

(3.15) 

Proof We again use the invariance by the orthogonal group K of the determinant and of 
the hyper geometric function. For k 6 K, we have 

Jnn(e-n) A e - tt (z ){t )) a + b 



/nn(e-n) A(e-7r(z)(t)) a '+ b 

f A{e-k- l t) a+a '-^A{k-H) b -^ „ t , , , lNI 

/ — \( / w^w+e, ^(a^b-a + a'-e-k-H^t. 

Jnn(e-n) A(e - n(z)(t)) a + b 
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Setting y = k l t in last integral, we get 

f A(e-y) a+a '~rA(y) b ~^ 

I = / — , w, ss a , +h 2F 1 (a,b;a + a';e-y)dy 

Jnn{e-n) A(e - ir(z){ky)) a + b 

f A(e - A:y) a+a '-^A(A;y) 6 -^ ^ . , , 

= L { e-n } A(e 2i?1 ^ + «^-y) d V 
_ ^ (a)m{b) m f f A(e-kyy+«'-vA(kyrv _ 

_ y (a) m {b) m f Aje-yT^A^Tl 

v {a)m(b) m , f A m+a+a ,_ ! i{e-y)A{y) b -7 
^ Q (a + a') m (?) m m inn(e-n) A(e - 7r(z)(y))-'+* ^ 

= Z w / n d m r / " , , , ,/ 2*1 (o + b,b;b + m + a + a ; z) 

^ {a + a') m ( T ) m Tn(m + a + a' + b) 

(a)m(ft)m , Tn(b)T n (m + a + a') ^ (ajfj)fcWfc , , , . 
^(a + a'W^)™ m r Q (m + a + a' + 6) ^ (6 + m + a + a') fc (*)* 

+ r (a) m (»m , rn(6)rn(m + a + a') 

= Z, TnV Z, f„ ■ „A ,nx d « 



fc>0 m>0 



a + o')m(7)m r n (m + a + a' + 6)(6 + m + a + a') fc 



V- ( a ' + b)k{b)k , , , , {a)m,{b) m d m T n (b)T n (m + a + a') ^(b + a + a' + m) 
= Z^ 7^ rf fcWJ 2^ 



/.■■-o (r)* ( a + «')m(7)™ T n (m + a + a' + b) T n (b + m + a + a> + k) 

^ (a' + b) k (b) k ^ (fljml^mrf™ r n (6)rQ(a + a') 

= 7^ <WfcUJ 2^ 



, (?)k V / ^ (6 + a + a' + fc) m (^) m r n (6 + a + a' + fe) 



\- {a' + b) k {b) k l T n (b)T n (a + a') >^ h ^ h a 



v (a' + b) k (b) k T n (b)T n {a + a') T n {a + a' + b + k)F n (a' + k) 

^ (f ) fc fe ^ lZJ r n (6 + a + a' + A:)r sl (a + a' + A:)r sl (a' + 6 + A : ) 



fc>0 



^ (%(aQfc , , , S n (b)T n (a' 



k>0 

rn(b)r n ( a Q , , 

r n (a' + b) ^i(a,6;a + a;z). 

□ 



We come now to the proof of Theorem 3.1. 
Proof of Theorem 3.1 Let X' be a random variable with distribution Ha' abi an d define 
V = 7r _1 (X')(e - X'). Then showing (3.14) is equivalent to show that V and tt(X)(W) 
have the same distribution. Let h be a bounded measurable function. Then 

E(h(V)) = [ h{it~ l {x){e-x))v a , A)b (dx) 
Jnn(e-Q) 

= C{a',a,b) f h{7r- 1 (x)(e-x))A{x) a '~^A(e-x) b -r 2 F 1 {a' ,b;a + a';x)dx. 

Jnn(e-n) 
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Setting y = ir 1 (x)(e — x), or equivalently x = it 1 (e + y)(e), then dx = A(e + y) r dy, 
and we have 



E{h(V)) = C(a',a,b) f h(y)A(7r- 1 (e + y)(e)) a '^A(e-7r' 1 (e + y )(e)) b -T 

2 F 1 (a, b;a + a; 7r _1 (e + y)(e))A(e + y)~~dy 

= C(a',a,b) [ h(y)A(7r- 1 (e + y)(e)) a ' +b A(y) b -v 2Fl (a', b; a + a'; n~\e + y)(e))dy. 
JQ 

Hence the density of V is 

f v ( v ) = C(a', a, b)A(n- l (e + v){e)f' +b A{vf-^ 2 F x [a' , b;a + a'; vr" 1 ^ + v)(e))l a (v). 

(3.16) 

On the other hand, the density of U = tt(X)(W) is given by 
fu(u) = / f x {x)fw{^ l {x){u))A{xy^dx 

= C(a,a / ,b) r " ( " / + ^ / A(x) a ^A(e-x) b -^ 2 F 1 (a, b; a + a'; x)A(ir- 1 (x)(u)) b -'. 

A(e + n- 1 (x)(u))- b - a ' A(x)~Tdx 



C(a, a', t) r ° ( ^| A( tt )H / A(x)^'-fA(e - z) fc -? A(* + «) 



-6-a' 



rn(a')rn(6) ' Jnn(e-n) 



2-Fi(a, 6; a + a'; x)tfe. 
With the change i = e — x, we get 

fu(u) = C(a,a\b)^±^-A(u) b -v f A(e - A(t) 6 "7 A(e + „ - t)"*-' 

2 -Pi (a, 6; a + a'; e — 

r n (a' + 6) A(n) 6 ~7 /■ A(e - t) a+a '~7 A(t) fe ~7 



U[a ' a > 0) T n (a>)Tn(b) A(e + «)«'+* Jnn(e- 



r n (a')r n (6) A(e + ./nn(e-n) A(e - ^(e + 

2-F1 (a, 6; a + a'; e — i)c/i. 
Using the fact that 7r _1 (e + u)(t) = 7r(7r _1 (e + u)(e))(t), and invoking Proposition 3.1, we 
obtain that 

r A(e-t) a+a '-TA(t) b -7 TP f U , / 

= / A(e - t) a+a '~T A(t) b -? A(e - t^tT 1 ^ + u)(e))(i))- a '- fc 2 iq(a, 6; a + a'; e - i)d* 

./fin(e-fi) 

Tn(b)T n (a') , , _ x 

= r < 1 1 u\ 2Fi{a ,b;a + a ;tt (e + u)(e)). 
1 n{a + b) 

Consequently, the density of U is equal to 

fu(u) = C(a, a', 6)A( 7 r- 1 (e + u){e)) a ' +b A{u) b ^ 2 F 1 (a', b;a + a'; w'^e + u)(e))l n («). 

(3.17) 
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Comparing (3.16) and (3.17), we conclude that the densities of U and V are equal, and 
consequently, their normalizing constants C(a,a',b) and C(a',a,b) are equal. □ 



Note that the fact that C(a, a', b) is a symmetric function of (a, a') means that 

3 F 2 (a,a,b;a + b,a + a';e) _ 3 F 2 (a' ,a' ,b;a' + b,a + a';e) 
T n (a')T n (a + b) " T n (a)T n (a> + b) ' 



(3.18) 



We can deduce another expression of the spherical Fourier transform of the beta-hypergeometric 
distribution from the following more general result. 

Proposition 3.1 1. For t = (t±, . . . , t r ) € M r and s = (si, . . . , s r ) € M r , the integral 

Ia,a',b(t, s) = A t (x)A s (e - X)fl ata > tb (dx) 

converges if and only if for i = 1, . . . , r, 

i-l i - 1 , 
U > — ^ a, Si> — b, 

and for all 1 < k < r , 

^ + ka' > 1 + k(r - k) - k ^ + l \ 
i=i 2 

In this case, we have 

Tq(q + 6)r^(a + t)Tn(b + s) 3 F 2 {a + t,a,b;a + b + t + s,a + a';e) 



I a ,a',b(t, s) 



T n (a)Tii(b)T Q (a + b + t + s) 3 F 2 {a,a,b;a + b,a + a';e) 

(3.19) 



2. We also have under the conditions J2i=i ti + ka > 1 + k(r — k) — k^-^-, for all 1 < 
k < r, 



t u n\ f a / \ (a \ 3-^2 a ,Q -t,6;a + b, a + a ; e) 

Ia,a',b{t,0)= &t{x)Va,a',b{dx) = ■ 3.20 

Jnn(e-n) 3 F 2 (a' ,a f ,b;a' + b,a + a';e) 

Proof 

1) For simplicity, we denote C = C(a,a',b). We first calculate the integral 

Ia,a',b(t,s) = / A t (x)A s (e - x)fi ay a> yh (dx) 

Jnn(e-n) 

= C A t (x)A s (e-x)A(x) a ~^A(e-x) b 'r 2 F l (a,b;a + a';x)dx. 

As the determinant and the hypergeometric function are K- invariant, for k £ K, we have 

I a ,a',b(t,s) = cf A t (x)A s (e-x)A(k' 1 x) a ~^A(e-k' 1 x) b '^ 2 F 1 (a,b;a + a;k~ 1 x)dx. 

Jnn(e~n) 
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Setting y = k l x, we get 

I a ,a',b(t,s) = C[ A t (ky)A s (e-ky)A(y) a -TA(e-y) b -^ 2 F 1 (a,b;a + a';y)dy 



= C ( A t (ky)A s (e - fcy)A(fcy)- ? A(e - fey) 6 "? £ /^iwf? 

Jnn(e-Q) ^ [a + a'J m (-) m 

Since all terms are positive we can invert sums and integrals, whether they converge or 
not. Hence 



Wt, s) = C £ ^rJ ^:? / / A ( (# s (e - ky)A(ky)S A(e - 

A m (ky)dkdy. 



It follows that 



4,a',&(M) =C E / " A m d r» / A m+(l+t _^ (z) A s+6 _ f (e - *)<fe. 

m > V a + a )m\r)m JQn(e-n) 

(3.21) 

This last integral converges if and only if a + t j > ^ and 6 + Sj > ^ , and under these 
conditions, it is equal to 

^ (o + a') m (7)m m r Q (m + t + a + s + 6) " 

Thus 

r ^ c ^ _ r ST ( a )m(b)m A T n {m + t + a)T n {s + b) 
a ' a ' M ' j " 4 (a + a') m (^) m dm r n (m + t + a + S + 6) 

(Q)m(fc)mft + a)mrfm + a)Tn{s + 6) 

,„ , (a + a') m (t + a + s + b) m {^) m T n {t + a + s + b) ' 



From Proposition 2.2, this series converges if and only if for all 1 < A; < r, 

Si + ka' > 1 + k(r - k) - k ^ + l \ 
i=i 2 

and under this condition, we have that 

a,a ''^ ' Sj 3^2(0, a, ft; a + ft, a + a'; e) r Q (a)r n (ft)r n (t + a + s + ft) ' 

2) For this second part, we use Theorem 3.1. Consider two independent random variables 

X ~ ^,,6 and IF ~ Then X' = Tr^e + ir(X)(W))(e) ~ /v,a,6. 

Since vr- 1 (^ / )(e - X') = tt(X)(W) and E(A t (W)) = Ta ^ n n ( ^ t \ we have 

E(A t (Tr(X)(W))) = E(A t {X))E(A t {W)) 

= E(A t (7r-\X')(e - X'))) 
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It follows that 



1 E(A_ t (X')A t (e-X')). 



E(A t (W)) 

Now we apply the first part of the proposition by replacing (a, a', b, t, s) by (a', a, 6, — t, t), 
getting the result for ^ — b < U < a' — ^ and X)i=i*i + ^ a > 1 + M r ~ k) — 
f° r an 1 < A: < r. Under these conditions, we obtain that the spherical Fourier 
transform of X is 

w(\(YW 3 F 2(a',a' -t,b;a' + b,a + a';e) 

E{MX) > ~ 3 F 2 (a',a',b;a' + b,a + a';e) ' ^ 

Finally, we observe that the right hand side of (3.22) is finite if and only if for all 1 < k < r, 
J2i=i ti + ka > \ + k{r — k) — k 1 ^- and it is a positive analytic function of t satisfying 
this condition. The principle of maximal analyticity implies that (3.20) holds for t such 
that for all 1 < k < r, Ylt=i U + ka > 1 + k(r - k) - k^±±l. 

□ 



Remark 3.1 1. From (3.19) and (3.20), we obtain two different expressions of E(A t (X)). 
Equating these expressions and recalling (3.18), we obtain the following relation con- 
cerning the function 3F2. 

3 F 2 (a + t,a,b;t + a + b,a + a'; e) _ 3 F 2 {a' ', a' - t,b;a' + b,a + a'; e) 

T Q (a')T n (a + b + t) ~ T Q (a + t)T Q (a' + b) ' [ ' j 

fort i > i Tr-a and £* =1 U + ka > 1 + k(r - k) - A;^±i) f or a u \<k<r. 

2. Using the characterization of the beta-hypergeometric distribution by its spherical 

Fourier transform given in (3.22), we can easily show the converse of Theorem 3.1, 

(2) 

that is if X and W are two independent random matrices in U such that W ~ Pba>> 
then 7r _1 (e + Tr(X)(W))(e) ~ H a ',a,b implies that X ~ H a ,a',b- 

Next, we give the matrix version of (1.4). 

Theorem 3.2 1. Let W ~ P(,a> W ~ @b a' an d ^ ^ e three independent random vari- 
ables, with X valued in £1. Then 

X~7r- 1 (e + 7r- 1 (e + vr(X)(VF / ))(VF))(e) if and only if X ~ >b (3.24) 
(2) 

2. IfW ~ a and X £ £1 are two independent random variables, then 

X ~ n-\e + ir(X)(W))(e) if and only if X~ a a ^ b (3.25) 
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3. Let (W n ) n >i and {W' n ) n >i be two independent sequences of random variables with 

(2) (2) 

respective distributions /3^ a and fi\ a f Then fJ, a ,a',b ^ s the distribution of the random 
continued fraction 

~w[ • (3-26) 



e + 



e+- 



Proof We adapt the method of proof used in the real case by Asci, Letac and Piccioni [1] 
to the matrix case. 

1. Observe first the series (3.26) converges almost surely, because the series ^2 n iW~ l + 
W^ 1 ) diverges almost surely. Consider the sequence (F n )^ =1 of random mappings 
from Q n (e — S7) into itself defined by 

F n (z) = Tr-^e + Tr-^e + K(z)(W' n )){W n ))(e). 

Since Fi o . . . o F n (z) has almost surely a limit X, then the distribution of X is a 
stationary distribution of the Markov chain w n = F n o . . . o F± (z) which is unique. 
According to Theorem (3.1), we have that [x a ,a',b is a stationary distribution of the 
Markov chain (u> n )^L . It follows that X ~ fJ> a ,a',b- 

2. We use the reasoning above with the random mappings G n (z) = 7r~ 1 (e+7r(z)(W n ))(e) 

3. The proof of this part is similar to the first part. 

□ 

In the following theorem, we establish the identifiability of the beta-hypergeometric dis- 
tribution on symmetric matrices. 

Theorem 3.3 Let (a,a',b) and (01,0^,61) in Q 2 -^-, oo[) 3 . 

If Ha,a>,b = Vaua'^bii then (°' °'' fe ) = (oi^'lA)- 

Proof For the sake of simplification, we denote C = C(a, a', b) and C\ = C(a\, a[, b\). 
For 1 £ S] fl (e - SI), we have that 

limA(e-x)^ 2 F 1 (a,b;a + a';x) = linj tA(e - *) 6 ^ ]T 

• E ^ u x ~> u m> Q \ a * a )m ( r )m 

lim A(e-x) b -rd (0) ... j0) 



,. A / (a)m{b) m dm 1 1 x 

+ bmA(e-x) r ^ m (x) 

U m>0;m^0 ^ + ° > m W V 

= lim A(e-x) b --d (0i ... i0 ) 

r a I \6-- ( a )m(^)m d m , . 

+ J™ E A ( e -^) r fQ+a0 fg) M*)- 
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Since d(o,...,o) = 1> an d 

Mm £ A (e -^-?g^^«x)=0, 

^ U m>0;m^O i« + O V I r V 

we conclude that 

lim A(e — 2-^1 (a, 6; a + a'; x) = 1. 

a;— >0 

Thus, when x is close to 0, the densities of fi a ,a',b and n aia > ^ are respectively equivalent to 
CA(x)°-? and dA(x) ai -?. Since Ma , a ,, 6 = /v,^, we get CA(x) a ^ = dA^"?. 
Hence a = a±, and it follows that for all x in $7 n (e — O), 

A(e-x) 6_ r 2 -Pi(a, 6; a + a';x) = A(e - x) fel ~- 2-^1(0, 61; a + a[; x). 

Using Proposition XV.3.4 page 330 in [4], we can write for linfin(e-O), 

2-Pi(o, 6; a + a'; x) = A(e - x)~ b 2-^1 (a', a + a'; — x(e - x) -1 ) 

and 

2 F 1 (a, bi; a + a[;x) = A(e - x)~ bl 2 Fi(a' 1 ,b 1 ; a + a[; -x(e - x)" 1 ). 

Therefore 

2 -Fi(a', b; a + a'; 2) = 2-^1 (a'i, h; a + a' x ; 2), 

or equivalently 

E (a')m(b)m dm , , n _ \ ^ {a'l)m{bl)m d rn 
m > K c )m y r )m m > \Cl)m K r )m 

where c = a + a! and c\ = a + a[. 

Since 4> m {z) is a polynomial in z with degree equal to \m\ = mi + . . . + m r , this implies 
that f t 

(fl )m(b)m d m ^ (di)m(&l)m 

( c )m (7)01 ( c l)m (7)01 

for each m > 0. 

For m = (1, 0, . . . , 0), we obtain 

a'b _ a[bi 

c C\ 

For m = (1, 1, 0, . . . , 0), we obtain 

( a /-i)(b-i) _ ( a ;-i)( bl -i) 
(c-i) (ci-J) ' 

Finally, for m = (1, 1, 1, 0, . . . , 0), we obtain 

( a '-i)(b-i) = ( Q ;-i)( fcl -i) 

(c-l) (Ci-1) 

Let 

Ao = ^, A, = '° f - and A^ '"'- 1 ^- 1 ' . 
c (c-i) (c-l) 
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By taking suitable linear combination, we get 

11 1 

a'b = cA , a + b = 2cA - 2(c - -)Ai + -, c(A 2 + A - 2Ai) + Ai - A 2 - - = 0. 

From this, c can be uniquely determined, we get c = c\ then a' = a' ± , and b = b\. □ 



Theorem 3.4 Let X be a beta-hypergeometric random matrix, X ~ a' 6- Then 
(e — X) ~ A* 0lja ' */ a^d onZy «/ a\ = a' , a = a[ and b± = b = a + a' = a\ + a' ± . 

Proof (<=) This way is obvious. 

(=>) Suppose that X ~ n a ,a',b and e — X ~ Moi^i.fci- Since the beta-hypergeometric 
distribution is .ftT- invariant, it is characterized by its spherical Fourier transform. 



E(A t (e-X)) = C(a,a',b) [ A t (e - x)A(x) a - 7 A(e - r 2 Fi(a, 6; a + a'; x)dx 

JSin(e-JJ) 

= C(a,a',b) A t+6 _n(e - x)A(x) a ~- 2 Fi(a,b;a + a';x)dx. 

Jnn(e-n) 

= C(a,a',b) / A t+6 _n(e - x)A(x) a ~- 2^1 (a, 6; a + a'; k~ 1 x)dx, 

Jnn(e-n) 

where the last equality is due to the fact that the hyper geometric function is .fT- invariant. 
Setting y = k~ 1 x, we obtain that 

E(A t (e-X)) = C(a,a',b) [ A t+6 _ 2 (e - ky)A(ky) a -^ 2 F 1 (a, b; a + a'; y)dy 

Jnn(e~n) 

= C(a,a',b) J2 m / / A *+^( e " ky)A m+a _,(ky)dkdy 

^ (a + a')m (7)™ inn(e-Q) 

= C(a,a',6) £ | Q) r ( n m ,f? / A t+b _ 2 (e - y )A m+a _, 

(a + a' m (?)m innfe-Q) 



m>0 



The last integral converges when t i + 6 > ^ for all 1 < i < r. Under this condition we 
can write that 

E(A t (e-X)) = C(a,a',b)j: {a)m{b)m ^ r °( m + + 6 > 



, (a + a')m (7)™ r^(m + a + t + 6) 

dm ro(a + b)T n (t + 6) 

m Q (a + a') m (a + t + 6) m (**) m rn(6)rQ(a + t + b) 3 F 2 (a, a, 6; a + 6, a + a'; e) 

r^(a + 6)r^(t + 6) 3-F 2 (a, a, 6; a + a', a + 6 + t; e) 



E 



rQ(6)rn(a + t + 6) 3-^2(0, a, 6; a + 6, a + a'; e) 

which is defined for t such that X)i=i U + > 1 + — k) — k ^'+ l "> for all 1 < k < r. 
Also since e — X ~ M01 ,0^,611 we use (2-13) for t such that for 1 < i < r, ij + ai > to 
obtain that 

T n (a + b)r n (t + 6) 3 F 2 (a, a,b; a + a' ,a + b + t; e) 
Tn(b)Tn(a + t + b) 3 F 2 (a, a, b; a + b, a + a'; e) 

_ r^(ai + 6i)rq(t + ai) 3^2(01,^1,01 +t;ai j-a^ai + 61 +t;e) 
rn(ai)rn(ai + t + 61) 3^2(01, 01, &i; ai + 61, ai + a' x ; e) 
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The last equality is equivalent to 

3 F 2 (ai, 61, ai + t;ai+ a[,ai +bi+t; e) 
3 F 2 (a, a,b; a + a' , a + b + £; e) 

Tn(a + b)Tn(ai) 3F 2 (a 1 ,a 1 ,b 1 ;a 1 + &i, ai + a[; e) T n (t + b)r n (ai +_H-6i) 
" r n (6)r n (ai + 61) 3J F 2 (a,a,&;a + &,a + a';e) r n (a + £ + b)F n (t + a{) ' 

Hence the function £ h-» 3F2 ^°y,^ a ^ f a ^ 1 ^"^*^ 1 ^ bl,e ^ is expressed in terms of gamma func- 
tions. This happens if and only if b± = a\ + and b = a + a'. In this case we have that 
e — X ~ , and X ~ 0^1, ■ However when X ~ 0^1/, we have that e — X ~ /?!;P„. 
Hence ai = a' and = a. □ 



Proposition 3.2 TTie following convergences in law hold: 
1- lim/i a ,a',6 = £0 and lim ^ a o / b = 6 e , 
2. lim ^ a o / b = S e and lim fi a a , b = 

r~i' i.fl n ' Lrv^ 1 



3- lim/Va' ,6 = <^e, lim // oa / 6 = 5 if a - ^—^ < a' and lim /x oa / 6 = ^ , , if a < a 
Proof For the proof, we will use the spherical Fourier transform. 

1) For the first part, we need to show that, for £ E M r such that J2i=i U> 1 + k(r — k) — 
^±12, 1 < k < r, 

,. 3F 2 (a' ,a' - t,b;a' + b,a + a';e) 

lim = (J. 

a^o 3^2(0', a', 6; a' + 6, a + a'; e) 

In fact, as 3 F 2 (a', a' - £, 6; a' + 6, a + a'; e) = E m >o T^T^Tp^ x (a+i%. ' tlien using the 
fact that a >-» is a decreasing function of a on (*^, 00) and that 

\ ^ I (a i)m{b^)mdm i 

4 ' (a' + 6) m (?) m 1 °°' 
the monotone convergence theorem enables us to invert sum and limit to get 
lim 3F2 (a, a' — £, b; a' + b, a + a 1 '; e) = 2 iq (a' — £ , 6; a' + 6; e) . 

a— >-0 



Similarly, we show that 



Therefore 



lim 3^2(0', a', b; a + 6, a + a'; e) = 00. 

a— >0 



a— >0 



On the other hand, when a — > 00, all the terms in the numerator and in the denominator go 
to zero except the one corresponding to m = (0, 0) which is equal to 1. Thus spherical 
Fourier transform tends to 1, which implies that 

lim fi a ,a',b = Se- 
ct,— >oo 
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2) We will use the result established in Theorem 3.1, that is if X ~ fJ, a ',a,b is independent of 
W then 7r- 1 (e + 7r(X)(iy))(e) 

~ Ma,a',6- Thus according to the point 1) established 

above, we have that 




With the same reasoning, we see that 

hm Ha,a',b = Pal- 

3) Similarly, except the term corresponding to m = (0, ...,0), which is equal to 1, all the 
other terms in the numerator and in the denominator go to zero when b tends to zero. 
Thus the spherical Fourier transform tends to 1, which implies that 

lim u aa ' b = 8 e - 
b^o ^ ' ' 

When b -> oo, we have, fort G R r such that Yli=i U+k(a-a') > l + k(r-k)-k^^-, 1 < 
k < r, 

hm 3 F 2 (a , a -t,b;a +b,a + a;e)= hm \ - x ■ 

fe^oo f^oo^ (a + a')m(^) m (a' + 6) m 

Here also, we can invert the sum and the limit to obtain that 

lim 3^2(0', a* — t, b; a' + b, a + a'; e) = 2-^1(0', a' — t; a + a; e). 

6— s-oo 

Similarly, 

lim 3^2(0', a', &; a' + b, a + a'; e) = 2-^1(0', a'; a + a; e). 

b— s-oo 

In the case where a' < a — the spherical Fourier transform of fi a ,a',b tends to 

2-Fi(a', a' - t; a + a';e) _ rQ(a)rn(a - a' + t) 
2 Fi(a', a'; a + a'; e) T^a - a')rn(a + t) ' 

which is the spherical Fourier transform of /3^„/ „/ • 

Otherwise the spherical Fourier transform of n a ,a',b tends to 0, in which case 

lim [i aa , b = 5 . 
0^00 

□ 
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